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ABSTRACT 

The  F-22  Raptor  is  a  unique  aircraft  with  many  technological  advantages  and  superior  capabilities.  The 
aircraft’s  stealth  capability  is  a  function  of  many  design  aspects,  including  coatings  that  cover  the  outside 
of  the  aircraft  and  help  mitigate  radar  detection.  Maintaining  these  Low  Observable  coatings  has  its  own 
set  of  challenges  to  include  an  inexperienced  work  force,  time  consuming  procedures,  and  demanding 
maneuvers  of  a  fifth  generation  fighter  aircraft.  Another  challenge  facing  the  F-22  fleet  is  low  aircraft 
availability,  where  the  aircraft  is  down  for  numerous  reasons.  Using  a  simulation  built  in  ARENA,  pro¬ 
cess  improvements  to  Low  Observable  maintenance  can  be  quantified  with  a  goal  of  improving  aircraft 
availability.  One  example  of  process  improvements,  the  use  of  extra  stock  panels  is  tested  in  the  simula¬ 
tion  to  see  the  potential  marginal  improvement  to  Aircraft  Availability. 

1  THE  AIRCRAFT:  F-22  RAPTOR 

Designed  as  a  fifth  generation  fighter  aircraft  and  a  member  of  the  Global  Strike  Task  Force,  the  F-22  is 
capable  of  air  to  air  and  air  to  ground  missions.  The  aircraft’s  stealth  capability,  known  as  Low  Observa¬ 
ble  (LO)  is  essential  to  maintaining  its  superiority.  Proper  maintenance  of  the  stealth  capability  insures 
the  Raptor  will  avoid  radar  detection  and  can  perform  all  its  varied  capabilities  (Hill  2010).  The  Raptor  is 
stationed  at  a  variety  of  locations  which  adds  to  the  complexity  of  aircraft  maintenance. 

1.1  Aircraft  Availability 

Aircraft  Availability  is  a  metric  that  assesses  the  readiness  of  a  wing  or  fleet  to  meet  its  stated  mission.  In 
its  simplest  terms,  aircraft  availability  can  be  defined  as  the  ratio  of  time  available  to  do  a  mission  to  total 
time  a  unit  possesses  the  aircraft.  Equation  1  shows  the  mathematical  formula  for  calculating  availability. 

,  TAI-NMCM -NMCS-NMCB -UPNR- DEPOT  MC 

A0= - = -  (1) 

TAI  TAI 

In  Equation  1,  all  units  are  in  hours.  TAI  or  Total  Active  Inventory  is  the  number  of  hours  the  fleet  of  air¬ 
craft  can  perform  its  mission.  The  next  five  variables  represent  the  hours  an  aircraft  is  not  available  to 
complete  its  mission  because  it  is  in  one  of  five  maintenance  statuses.  The  five  maintenance  statuses 
shown  are  Non-Mission  Capable  due  to  Maintenance  (NMCM),  Non-Mission  Capable  due  to  Supply 
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(NMCS),  Non-Mission  Capable  due  to  Both  Maintenance  and  Supply  (NMCB),  Unit  Possessed  Non- 
Reporting  (UPNR),  and  Depot  Level  Maintenance  (DEPOT).  This  research  focuses  on  Non-Mission  Ca¬ 
pable  due  to  Maintenance  (NMCM),  which  accounts  for  approximately  22%  of  the  aircraft’s  total  active 
hours.  Low  Observable  System  Maintenance  is  a  small  subset  of  NMCM,  less  than  a  quarter  of  NMCM 
hours.  Thus,  improvements  to  aircraft  availability  through  Low  Observable  maintenance  practices  will  be 
small,  but  significant  none  the  less. 

2  PROBLEM  DEFINITION 

One  example  of  improved  maintenance  processes  is  the  idea  of  using  extra  supply  of  panels.  Certain  pan¬ 
els  are  available  to  replace  damaged  panels  and  return  the  aircraft  to  its  mission  in  a  fraction  of  the  time 
compared  to  previous  methods  with  no  extra  panels.  The  damaged  panel  is  then  repaired  offline  in  a 
work  area  where  it  will  become  extra  supply  for  the  next  damaged  panel.  Using  Subject  Matter  Expert 
opinions,  1 6  panels  were  chosen  as  extra  panel  candidates  and  grouped  into  six  panel  types  based  on  simi¬ 
lar  repair  distributions. 

When  a  panel  is  converted  to  extra  supply  panel,  no  additional  manpower  or  resources  are  required 
that  was  not  being  used  when  the  panel  was  not  extra  supply.  The  decision  of  when  to  repair  the  damaged 
panel  is  not  affected.  By  having  extra  supply  panels  there  is  now  another  option.  The  work  to  repair  the 
damaged  panel  is  still  performed;  however,  the  aircraft  is  no  longer  down  waiting  for  panel  repair.  Extra 
supply  of  panels  allow  the  aircraft  to  return  to  Mission  Capable  status  quicker  by  removing  the  time  to  re¬ 
store  the  panel  from  the  aircraft’s  critical  path.  Subject  Matter  Experts  believe  when  an  extra  supply  pan¬ 
el  is  used,  10%  of  previous  maintenance  time  is  still  required  to  account  for  physically  removing  and  re¬ 
placing  the  panel. 

3  LITERATURE  REVIEW 

3.1  Simulation 

Given  the  complex  nature  of  Low  Observable  aircraft  maintenance  and  the  need  for  sensitivity  analysis,  a 
simulation  was  chosen  to  model  the  extra  supply  panel  process.  As  a  problem  solving  tool  simulations 
can  be  very  powerful.  Although  a  model  is  only  an  abstraction  of  reality,  there  are  many  benefits  of  using 
a  simulation  for  analysis.  Modeling  a  problem  allows  for  exploration  of  key  variables  and  processes 
without  costly  commitments  or  repercussions.  Simulations  also  allow  for  visualization  and  analysis  of 
complex  systems  too  intricate  for  mathematical  equations  or  direct  experimentation  (Banks  et  al.  2005). 
Montevechi  and  Pinho  (2007)  suggest  that  simulations  are  a  useful  tool  because  they  offer  automation, 
replication  and  higher  comprehension  at  a  fraction  of  the  cost  of  actually  implementing  proposed  changes. 
A  limitation  to  using  simulation  is  the  tradeoff  between  model  accuracy  and  the  confidence  in  observa¬ 
tions  and  analysis.  The  power  of  subsequent  analysis  stems  from  the  strength  of  the  model  itself.  The 
process  of  assessing  the  strength  or  adequacy  of  a  model  is  known  as  Verification  and  Validation  (V&V). 
Jordan,  Melouk,  and  Faas  (2009)  discuss  the  importance  of  V&V  in  simulation  and  offer  some  common 
challenges  to  the  process.  They  note  that  V&V  is  time  consuming,  can  be  costly,  is  difficult,  complex, 
and  requires  more  data  than  sometimes  is  available.  Despite  the  disadvantages,  model  builders  agree  that 
V&V  is  important  and  often  use  subject  matter  experts  and  personnel  in  the  shop  to  check  the  model 
structure  and  data  input.  Another  way  a  model  is  verified  for  robustness  is  by  varying  the  inputs  across  a 
range  and  checking  the  output  for  trends  in  the  correct  direction.  For  example,  if  personnel  were  de¬ 
creased  in  the  model,  one  would  expect  wait  time  of  entities  to  increase.  This  confirmation  allows  for 
greater  confidence  in  the  results  presented. 

3.2  Simulations  in  Aircraft  Maintenance  and  Sortie  Generation 

Lessons  were  also  learned  from  similar  simulations  in  aircraft  maintenance.  The  United  States  Air  Force 
uses  a  variety  of  simulation  analyses,  employing  models  such  as  LCOM  (Logistics  Composite  Model), 


2531 


Ysebaert,  Johnson,  Miller,  and  Pettit 


SIMFORCE  (Scalable  Integration  Model  for  Objective  Resource  Capability)  and  LogSAM  (Logistics 
Simulation  and  Analysis  Model).  Boyle  (1990)  discusses  LCOM  in-depth  while  Faas  (2003)  gives  a 
overview  of  all  three  Air  Force  Models.  SIMFORCE  is  built  in  ARENA  and  could  be  of  potential  use  for 
future  research  in  Low  Observable  maintenance  practices  as  a  desktop  tool  for  decision  makers.  Alt¬ 
hough  other  capable  programs  are  available,  each  of  these  models  has  varying  levels  of  complexity  and 
limited  adaptability  and  was  not  chosen  to  implement  this  research. 

Faas  (2003),  Iakovidis  (2005),  and  Parks  (2010)  successfully  conducted  aircraft  maintenance  simula¬ 
tions  in  ARENA.  This  suggests  the  software  is  credible  and  capable  of  what  we  want  to  model.  A  simi¬ 
lar  approach  was  also  taken  by  the  authors  mentioned  above  by  simulating  aircraft  as  entities  flowing 
through  the  model,  and  keeping  track  of  key  details  to  trigger  flow  through  certain  maintenance  process¬ 
es.  The  authors  found  success  using  similar  simulation  structures,  with  each  section  of  the  model  having 
a  unique  function,  and  all  sections  then  tied  together  through  logic  gates.  This  model  building  technique 
allows  for  stepwise  model  construction  and  greater  confidence  in  an  accurate  model. 

3.3  Designed  Experiment  and  Marginal  Analysis 

Design  of  Experiments  (DOE)  is  the  procedure  of  systematically  testing  design  factors  (inputs)  at  varying 
levels  to  discover  if  a  factor  is  important,  or  has  a  significant  effect  on  the  output  of  interest.  As  described 
by  Kelton  (1999),  “One  of  the  principal  goals  of  experimental  design  is  to  estimate  how  changes  in  input 
factors  affect  the  results  or  responses,  of  the  experiment.”  In  general,  DOE  can  be  used  to  screen  which 
factors  are  important  or  to  predict  optimal  factor  combinations.  DOE  is  used  primarily  in  real  life  (physi¬ 
cal)  systems,  but  can  also  be  applied  to  deterministic  and  stochastic  simulation  models  (Kleijnen  2008). 

There  are  many  advantages  of  using  experimental  design  in  simulations  as  demonstrated  in  articles  by 
Kelton  (1999),  Kleijnen,  Sanchez,  and  Lucas  (2005),  Kleijnen  (2008),  Montevechi  and  Pinho  (2007),  and 
Sanchez  (2006).  Montevechi  and  Pinho  (2007)  show  that  there  are  many  advantages  to  combining  these 
two  different  techniques,  to  include  “avoiding  trial  and  error  to  seek  solutions”  and  “improving  the  per¬ 
formance  on  the  simulation  process,”  Kleijnen,  Sanchez,  and  Lucas  (2005)  asserts  that  the  two  methods 
rarely  combine  because  “research  related  to  design  of  experiments  is  frequently  found  in  specialized  mag¬ 
azines,  rarely  read  by  simulation  practitioners.”  Knowing  that  a  simulation  is  a  model  of  the  real  world, 
one  can  think  of  it  as  a  black  box  “that  implicitly  transforms  inputs  (such  as  factor-level  settings)  into 
outputs”  (Kleijnen,  Sanchez,  and  Lucas  2005).  The  designed  experiment  of  interest  can  be  represented  as 
RV  =  f  (IV),  where  the  response  variable  ( R  V)  or  output  of  the  experiment  is  some  function  of  the  input 
variables  ( IV)  or  factors.  The  transformation / represents  the  simulation  itself  (Kelton  1999). 

There  are  also  many  advantages  of  using  simulation  as  the  transformation  from  input  to  output,  as  op¬ 
posed  to  an  operational  test.  One  advantage  is  the  control  over  all  input  variables.  Error  is  greatly  re¬ 
duced  because  of  the  control  over  all  the  factors  (Montevechi  and  Pinho  2007).  Another  advantage  is  the 
ease  of  replication  in  a  simulated  environment.  Many  replications  of  the  model  lead  to  more  accurate  es¬ 
timations  of  the  interactions  and  main  effects,  as  well  as  narrower  confidence  intervals. 

One  specific  designed  experiment  known  as  the  “shopping  list”  approach  was  used  in  determining 
which  panels  to  acquire  based  on  a  marginal,  or  per  unit,  increase  to  availability.  This  approach  is  based 
on  the  Aircraft  Sustainability  Model  (ASM),  created  by  the  LMI  Corporation  for  the  United  States  Air 
Force. 

The  ASM  is  a  “mathematical  model  that  computes  an  optimal  spares  mix  to  support  a  wide  range  of 
possible  operating  scenarios”  (Slay  et  al.  1996).  The  ASM  gives  a  “shopping  list”  of  spare  parts  that 
should  be  purchased  based  on  a  user  defined  metric  such  as  availability,  subject  to  a  constrained  budget. 
A  benefit  to  cost  ratio  should  be  maximized  when  choosing  which  parts  to  have  in  supply.  Shown  in  the 
ASM  Report,  Figure  1  depicts  the  solution  curve,  where  availability  or  budget  can  be  specified,  and  the 
other  variable  is  then  determined. 
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Dollars 

Figure  1 :  Aircraft  Sustainability  Model  shopping  list  curve 

4  METHODOLOGY 
4.1  Conceptual  Model 

To  offer  insight  into  Low  Observable  maintenance  and  specifically  the  benefit  of  extra  supply  panels,  a 
simulation  model  was  created  in  ARENA.  This  discrete  event  simulation  was  necessary  to  capture  the 
complex  nature  of  maintenance  processes  and  to  simulate  the  accrual  of  damages  to  the  aircraft’s  coat¬ 
ings.  Throughout  the  model  building  process,  subject  matter  experts  were  consulted  to  offer  their  experi¬ 
ence  and  give  estimates  when  actual  data  was  not  available. 

The  conceptual  model  for  the  simulation  is  shown  in  Figure  2.  First,  aircraft  are  created  then  checked 
against  a  schedule  to  see  if  any  planned  maintenance  actions  are  required.  If  so,  those  aircraft  are  re¬ 
moved  from  the  pool  of  available  aircraft. 


Figure  2:  Conceptual  simulation  model 


Next,  the  available  aircraft  fly  a  sortie,  followed  by  any  unscheduled  maintenance.  Then,  Low  Ob¬ 
servable  Maintenance  might  be  needed,  after  which  the  cycle  repeats.  The  shaded  regions  in  Figure  2 
represent  the  times  when  Low  Observable  maintenance  is  accomplished.  The  simulation  mirrors  one 
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squadron  of  20  aircraft.  The  entities  flow  through  six  sub  models  where  planned  actions  are  updated,  sor¬ 
ties  are  flown  and  regular  and  Low  Observable  maintenance  occurs.  The  entities  are  created  once  and 
never  leave  the  model,  they  are  only  delayed  at  certain  times  to  simulate  real  world  base  operations. 

4.2  Model  Verification  and  Validation 

Model  verification  is  the  process  of  creating  a  functional  model,  free  of  errors.  To  accomplish  this  task 
the  model  was  built  in  a  piece-wise  fashion,  building  one  sub  model  at  a  time  and  using  output  data  writ¬ 
ten  to  spreadsheet  files  to  verify  correct  scenarios.  Also,  low  level  detail  was  modeled  first  to  insure  cor¬ 
rect  logic,  followed  by  modeling  more  detailed  processes  once  the  foundation  was  correct. 

The  model  was  also  validated  by  consulting  with  experts  throughout  its  creation  for  accurate  data  and 
decisions  modeled.  Although  particular  values  are  not  releasable  in  this  paper,  we  found  that  simulated 
sortie  generation  rates,  yearly  audits,  and  depot  maintenance  frequency  all  compared  well  to  actual  val¬ 
ues.  Damage  Type  and  Frequency  was  also  validated  by  expert  opinion.  Status  hours  for  the  fleet  and 
each  base  were  provided  for  select  data  entry  as  well  as  for  validation  purposes. 

4.3  Executing  a  Designed  Experiment-Marginal  Analysis 

Once  the  model  was  constructed,  properly  verified,  and  validated,  the  next  step  was  to  vary  inputs  and  see 
how  they  affect  the  associated  simulation  output. 

Aircraft  availability  is  the  primary  output,  defined  as  the  ratio  of  available  hours  to  possessed  hours. 
In  the  simulation,  the  total  active  inventory  (TAI)  consists  of  20  aircraft,  with  30  days  per  month  time  pe¬ 
riod.  Panel  Flours  is  a  secondary  output  of  the  model  and  is  the  summation  of  the  time  each  aircraft 
spends  in  the  panel  sub  models,  waiting  for  or  receiving  panel  maintenance.  To  measure  the  effect  of  ex¬ 
tra  supply  panels,  each  panel  type’s  quantity  is  varied  and  the  change  in  output  metric  is  recorded.  The 
six  variables  of  interest  are  the  resource  quantity  of  panel  types  1-6.  The  quantity  of  extra  panels  is  var¬ 
ied  over  categorical  levels  0,  1,2..  .n.  Zero  panels  represent  current  operations  with  no  extra  supply  pan¬ 
els  available  as  spares. 

To  realize  the  greatest  improvement  to  aircraft  availability,  ARENA’S  Process  Analyzer  was  used  to 
vary  the  six  controls  against  the  output  responses:  availability  and  panel  hours.  Availability  was  calculat¬ 
ed  as  the  one  year  average  after  a  six  month  warm  up  of  fifty  replications.  Fifty  replications  were  used 
because  it  helped  reduce  variability  seen  in  the  output  variables. 

Next,  a  “shopping  list”  approach  was  taken  to  realize  the  marginal  improvement  to  availability  as  one 
additional  panel  was  purchased,  or  selected.  Groups  of  six  runs  were  executed  and  the  panel  with  the 
highest  increase  in  availability  compared  to  the  previous  panel  scenario  is  chosen.  To  begin,  a  scenario  is 
created  where  only  one  quantity  of  each  panel  resource  exists  in  the  model.  The  scenario  is  run  and  the 
panel  resource  that  achieves  highest  availability  is  chosen  to  be  on  the  list.  Next,  an  additional  quantity  of 
the  chosen  panel  is  added,  and  again  the  scenario  is  run.  The  scenario  with  the  best  availability  with  two 
panels  is  selected,  and  the  second  panel  that  created  this  pair  is  added  to  the  list.  This  process  continues 
until  no  more  improvement  is  seen,  or  a  budget  runs  out  of  money.  The  use  of  “per-unit  input  increasing 
output”  logic  answers  the  question,  “If  I  could  only  purchase  one  more  panel,  which  one  would  it  be  to 
increase  availability  the  most?”  This  process  repeats  until  no  more  substantial  increase  in  availability  is 
observed,  or  until  the  budget  for  panels  is  exceeded. 

5  RESULTS  AND  ANALYSIS 

Given  the  nature  of  this  non-terminating  simulation,  our  first  objective  is  to  find  a  point  in  time  where  the 
output  leveled  out  and  entered  the  steady  state.  Fifty  replications  each  ten  years  long  were  used  for  trial 
runs.  In  these  runs  the  baseline  model  was  executed,  with  no  extra  supply  panels.  The  transient  period 
was  identified  at  six  months,  as  seen  in  Figure  3. 
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Figure  3  shows  that  there  is  some  cyclical  nature  to  the  output  and  this  behavior  was  retained  in  the 
steady  state  nature  of  the  model.  Availability  increases  around  the  50  month  and  110  month  marks.  This 
could  be  attributed  to  the  periodic  nature  of  aircraft  maintenance. 


Figure  3:  Transient  conditions  analysis  -  Abscissa  scale  is  in  months,  and  ordinate  represents  availability 

5.1  Test  Panel  Types  for  Marginal  Improvement  to  Availability 

Using  a  warm  up  period  of  six  months  and  a  monthly  average  for  one  year,  groups  of  panels  were  run  us¬ 
ing  the  “shopping  list”  approach,  executed  with  Process  Analyzer.  The  best  panel  combination  that  in¬ 
creases  availability  is  seen  from  Panel  3,  then  Panel  2,  Panel  5,  Panel  1,  Panel  4,  and  Panel  4.  Availability 
increased  1.2%  with  six  panels  over  the  base  case  of  zero  panels.  Although  overall  availability  is  increas¬ 
ing,  the  confidence  intervals  between  subsequent  panels  overlap  suggesting  that  the  increase  is  not  statis¬ 
tically  significant.  To  further  explore  this  idea,  Paired-/  tests  were  conducted  with  each  pair-wise  combi¬ 
nation  of  panels.  Paired-/  tests  were  used  because  Common  Random  Numbers  were  employed  in  the 
model,  synchronizing  the  model  replications  and  reducing  variability.  Paired-/  tests  compare  the  mean 
difference  between  scenarios  to  the  hypothesized  mean  difference  of  zero,  or  no  difference.  Because  the 
mean  difference  of  the  outputs  is  now  considered  independent  and  identically  distributed,  a  /-statistic  can 
be  used  to  compare  additional  panels  to  the  base  case  of  zero  panels.  The  test  gathers  strength  of  evi¬ 
dence  for  the  alternative  hypothesis  in  the  form  of  a  p-v alue,  that  the  mean  difference  is  not  equal  to  zero. 
Small  /i-valucs  support  the  case  for  rejection  of  the  null  hypothesis  in  favor  of  the  alternative.  Table  1 
shows  the  /i-valucs  for  the  comparisons  between  the  seven  scenarios,  with  the  bold  face  denoting  signifi¬ 
cant  “shopping  lists”. 

Table  1:  p-value  of  all  pair-wise  comparison  of  additional  panels 


No  Panels 

- 

(3) Fi rst  Panel 

0.328 

- 

(2)  Second  Panel 

0.221 

0.764 

- 

(5)  Third  Panel 

0.054 

0.146 

0.409 

- 

(1)  Fourth  Panel 

0.196 

0.551 

0.816 

0.527 

- 

(4)  Fifth  Panel 

0.029 

0.127 

0.296 

0.732 

0.242 

- 

(4)  Sixth  Panel 

0.025 

0.140 

0.304 

0.739 

0.302 

0.990 

- 
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For  example,  acquiring  one-each  of  the  respective  Type  3,  Type  2,  and  Type  5  panels  produces  an  in¬ 
crease  in  availability  over  the  base  case  of  zero  panels,  at  significance  p  =  0.054.  However,  acquiring 
these  three  panels  is  not  statistically  better  (p  =  0.409)  than  acquiring  only  the  first  two.  Of  interest  is  that 
subsequent  panels  never  show  a  marginally  significant  increase  in  availability  (as  seen  by  large  /?- values 
on  Table  1  ’s  main  diagonal),  but  adding  the  fifth  and  sixth  panels  both  produce  respective  availability  in¬ 
creases  over  the  base  scenario  of  zero  panels.  Also  of  interest  is  the  finding  that  while  adding  the  first 
three  and  then  a  respective  fifth  and  six  panel  is  statistically  desirable  compared  to  the  base  case,  we  ob¬ 
serve  that  adding  the  fourth  panel  is  not  (p  =  0.196)!  We  suspect  this  anomaly  is  due  to  “random 
bounce.”  The  overall  effect  of  panel  acquisition  increases  to  aircraft  availability  might  not  be  statistically 
significant,  but  the  panel  additions  may  be  practically  significant  for  the  maintenance  time  saved  by  using 
the  extra  supply  panels.  The  1.2%  effect  on  availability  is  not  profound  due  to  randomness  and  other 
maintenance  events  that  an  aircraft  encounters  in  the  model. 

5.2  Test  Panel  Types  for  Marginal  Improvement  to  Panel  Hours 

A  second  output  of  interest,  Panel  Hours  was  captured  at  the  same  time  the  experiment  was  run  for  Avail¬ 
ability.  Panel  Hours  is  the  summation  of  maintenance  time  the  aircraft  spend  in  a  back  shop  receiving  a 
new  panel  or  waiting  for  a  repaired  or  spare  part  panel.  The  less  time  an  aircraft  spends  in  non-mission 
capable  status  in  the  back  shop,  the  more  time  an  aircraft  can  perform  its  mission.  As  additional  panels 
are  acquired.  Panel  hours  decrease,  but  the  time  saved  may  not  translate  completely  to  increased  availabil¬ 
ity.  In  an  actual  flying  unit,  human  scheduling  can  provide  mitigating  actions  to  help  translate  panel 
hours  to  higher  aircraft  availability  and  represents  a  limitation  of  our  models. 

Using  the  “shopping  list”  approach,  six  different  panels  were  selected  to  decrease  panel  hours.  Using 
six  panels  saves  on  average  400  hours  over  the  scenario  with  zero  panels  in  extra  supply.  After  acquiring 
six  panels,  the  decrease  to  panel  hours  was  no  longer  significant. 

5.3  Cost  Benefit  Analysis 

Another  way  of  determining  the  best  shopping  list  of  panels  would  be  to  compare  the  marginal  availabil¬ 
ity  contribution  per  dollar  cost.  The  assumption  is  made  that  the  panel  types  are  constructed  and  stored 
similarly.  The  same  methodology  was  used  to  construct  the  shopping  list,  however  the  output  of  interest 
is  the  change  in  availability  per  cost.  Cost  is  calculated  as  a  function  of  the  size  of  the  panel  and  25%  car¬ 
rying  costs  for  storage  and  security. 

Thus,  an  additional  shopping  list  was  created  using  the  “shopping  list”  approach  and  panels  were  se¬ 
lected  based  on  the  greatest  change  in  Availability  to  Cost  ratio.  The  best  panels  in  decreasing  order  of 
ratio  improvement  are  Panel  3,  Panel  2,  Panel  5,  Panel  1,  Panel  4,  which  is  the  same  selection  found  when 
comparing  availability  alone.  Similarly,  panels  could  be  selected  based  on  the  change  in  Panel  Hours  to 
Cost  ratio.  This  analysis  resulted  in  a  different  selection  of  panels  for  the  shopping  list.  Table  2  shows 
the  three  main  goals,  their  respective  shopping  list  of  panels,  and  the  change  to  availability  and  panel 
hours  associated  with  that  purchase. 


Table  2:  Summary  of  shopping  list  goals 


Goal 

Shopping  List 

Availability 

Increase 

Panel  Hour 

Decrease 

Max  Availability 

3- 2-5- 1-4-4 

1.2% 

345 

Min  Panel  Hours 

1-3-2-6-5-4 

1.0% 

400 

Max  Cost  Benefit  (PH) 

6- 2-4- 6-5-3 

0.4% 

261 

The  point  estimate  of  the  mean  panel  hours  as  each  additional  panel  is  selected  is  shown  in  Figure  4. 
The  minimum  panel  hour  scenario  (blue  diamond  symbol)  reduces  panel  hours  the  most  but  has  the  high- 
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est  cost.  The  cost  efficient  scenario  (green  triangle  symbol)  resulted  in  the  highest  return  on  investment  at 
$6M  and  reduces  panel  hours  by  261  hours.  Thus,  different  scenarios  can  be  selected  based  on  a  specific 
goal.  Ultimately,  there  is  a  tradeoff  between  higher  availability  or  lower  panel  hours  and  increased  cost. 


Panel  Hours  by  Cost  Increase 


Figure  4:  Shopping  list  comparison 


6  CONCLUSION 

This  research  estimates  the  impact  on  aircraft  availability  by  stocking  extra  supply  panels  for  F-22  air¬ 
craft.  Flowever,  not  every  panel  offers  the  same  return  for  increased  availability  or  decreased  panel  hours. 
Panel  Type  1  offers  the  most  time  benefit,  while  Panel  Type  3  offers  the  best  availability  increase.  We 
believe  in  practice  that  the  time  saved  using  Panel  Type  1  could  be  better  utilized,  and  would  increase 
availability  the  most.  Also,  there  is  a  limit  to  how  much  availability  can  improve  from  using  extra  supply 
panels.  After  five  or  six  panels  are  purchased,  availability  must  be  improved  by  other  means.  Due  to  the 
small  scope  of  Low  Observable  maintenance  compared  to  the  larger  maintenance  picture,  improvement  to 
availability  was  expected  to  be  small.  Flowever,  aircraft  wait  time  saved  in  the  panel  shops  was  signifi¬ 
cant. 

As  a  recommendation  for  future  work,  an  area  of  improvement  could  be  to  arrange  for  aircraft 
maintenance  personnel  to  record  additional  information  on  repair  types  and  durations.  Our  available  data 
was  limited:  the  panel  frequency  and  durations  are  estimates  and  could  offer  clearer  analysis  if  future  da¬ 
ta  is  proven  to  be  more  accurate.  Also,  research  could  be  helpful  in  determining  an  optimal  scheduling 
function  for  the  F-22  fleet.  Treating  Low  Observable  as  a  subsystem  that  must  be  managed  up  front  in¬ 
stead  of  the  current  reactive  approaches  could  allow  better  aircraft  utilization.  A  scheduling  tool  could  al¬ 
low  for  more  opportunistic  maintenance,  whether  for  Low  Observable  or  regular  maintenance.  There  is  a 
balance  between  maintenance  and  operations,  and  a  more  analytical  schedule  could  offer  consistency  be¬ 
tween  maintenance  units  and  remove  the  manual  input  factor  that  is  currently  used. 

We  found  that  marginal  analysis  provides  a  simple,  intuitive  designed  experiment  approach  for  simu¬ 
lation-driven  inventory  estimation,  but  its  application  seems  under-represented  in  the  literature.  Hopeful¬ 
ly  this  paper  will  help  stimulate  more  widespread  adoption. 
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